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As usual, R and C denote the real and complex numbers. If z is a 
complex number, then z can be expressed as x + yi, where x, y are real 
numbers, called the real and imaginary parts of z, and i 2 — — 1. In this case 
the complex conjugate of z is denoted z and defined to be x — yi. 

These notes are connected to the "potpourri" topics class in the Department of Math- 
ematics, Rice University, in the fall semester of 2004. 
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If x is a real number, then the absolute value of x is denoted |x| and 
defined to be equal to x when x > and to — x when x < 0. Notice that 
\x + y\ < |x| + 1 2/ j and = \x\ \y\ for all real numbers x, y. 

liz — x + yi is a complex number, x, y G R, then the modulus of z is 
denoted \z\ and is the nonnegative real number defined by \z\ 2 = zz = x 2 +y 2 . 
For every pair of complex numbers z, w we have that \z + w\ < \z\ + |u>| and 
\zw\ = \z\ \w\. 



1 Normed vector spaces 

Let V be a real or complex vector space. By a norm on V we mean a function 
1 1 1>|| defined for all v G V such that ||v|| is a nonnegative real number for all 
v G V which is equal to if and only if v = 0, 

(1.1) H^^ll — \ a \ Ik || 

for all real or complex numbers cc, as appropriate, and all v G V, and 

(1.2) + < Nl + Ikll 

for all i>,tu G V. In this event ||t> — iu|| defines a metric on V. 

An inner product on a real or complex vector space V is a function (t>, ty) 
defined for v, w G V which takes values in the real or complex numbers, 
according to whether V is a real or complex vector space, and which satisfies 
the following properties. First, for each fixed w G V, (v,w) is linear as a 
function of v, which is to say that 

(1.3) (v + v', w) = (v , w) + (v', w) 
for all v, v' G V and 

(1.4) (av, w) — a (v, w) 

for all real or complex numbers a, as appropriate, and all v G V. Second, 
(v, w) is symmetric in v, w when V is a real vector space, which means that 

(1.5) (w, v) = (v, w) 

for all v, w G V, and it is Hermitian-symmetric in the complex case, which 
means that 

(1.6) (w, v) = (v, w) 
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for all v,w G V. As a result, (v,w) is linear in w for each fixed v in the 
real case, and it is conjugate-linear in the complex case. From the symmetry 
condition it follows that (v, v) is a real number for all v G V even in the 
complex case, and the third condition is that 

(1.7) (v,v)>0 
for all v G V, with 

(1.8) (v,v)>0 
when v ^ 0. 

Suppose that V is a real or complex vector space with inner product 
(v, w), and put 

(1.9) ' |H| = (^)V2 

for v G V. The Cauchy-Schwarz inequality states that 

(1.10) \{v,w)\ < \\v\\ \\w\\ 

for all v, w G V. This can be derived using the fact that 

(1.11) (v + aw,v+ aw) 

is a nonnegative real number for all scalars a. As a consequence, one can 
check that 

(1.12) + it; 1 1 < \\v\\ + \\w\\ 

for all v,w G V, by expanding \\v + w\\ 2 in terms of the inner product. It 
follows that \\v\\ defines a norm on V. 

A subset E of a vector space V is said to be convex if for each v,w G E 
and each real number t with < t < 1 we have that 

(1.13) tv + (1 — t) w E E. 

Suppose that ||i>|| is a real- valued function on V such that \\v\\ > for all 
v G V, \\v\\ = if and only if v — 0, and ||o!i;|| = |a| ||w|| for all scalars a and 
all v G V. Then defines a norm on V if and only if 

(1.14) {v e V : \\v\\ < 1} 

is a convex subset of V. In other words, this is equivalent to the triangle 
inequality in the presence of the other conditions. This is not too difficult to 
verify. 
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Fix a positive integer n, and consider R n , C™ as real or complex vector 
spaces. More precisely, R™ and C™ consist of n-tuples of real or complex 
numbers, as appropriate. If v — (v±, . . . , v n ), w = (wi, . . . , w n ) are elements 
of R™ or of C™, then the sum v + w is defined coordinatewise, 

(1.15) v + w = (vx + u>i, . . . ,v n + w n ). 

Similarly, if a is a real or complex number and v = (fi, . . . ,v n ) is an ele- 
ment of R n or of C n , as appropriate, then the scalar product av is defined 
coordinatewise, 

(1.16) av = (a 1 v 1 , . . .,a n v n ). 

The standard inner product on R n , C™ is defined by 

n 

(1.17) (v,w) = Y,v j w j 

j'=i 

in the real case and 

n 

(1.18) {v,w)^2vjWJ 

3=1 

in the complex case. If p is a real number with 1 < p < oo, then we put 

f n v l/p 

(i-i9) IHIp = (EW) 

in both the real and complex cases, and we can extend this to p = oo by 
(1.20) |H|oo = max(|ui|, . . . , |u n |). 

Notice that \\v\\ 2 is the norm associated to the standard inner product on 
R ra , C n . For all p, 1 < p < oo, one can check that ||i>|| p defines a norm 
on R n , C n . The triangle inequality is easy to check when p = l,oo, and 
when 1 < p < oo one can show that the closed unit ball associated to \\v\\ p 
is convex using the fact that t p is a convex function on the nonnegative real 
numbers. 

Suppose that 1 < p, q < oo and that 

1 1 

1.21 - + - = 1, 

P 1 
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with l/oo = 0, in which case we say that p, q are "conjugate exponents". If 
v, w are elements of R n or of C n , then 



;i.22) 



J2 V 3 W 3 
3=1 



< \\v\\p \\w\ 



q- 



This is Holder's inequality. 

When p = q = 2 Holder's inequality reduces to the Cauchy-Schwarz 
inequality. When p, q = l,oo one can check it directly using the triangle 
inequality for scalars. Now suppose that 1 < p, q < oo, and observe that 



;i.23) 



aP b q 

ab< 1 

p q 



for all nonnegative real numbers a, b, as a result of the convexity of the 
exponential function, for instance. Hence 



(1.24) 



3 ^3 



< 



P 



+ 



\W\ 



for all v, w in R n or in C n , by applying the previous inequality to 

and summing over j. This yields Holder's inequality when \\v \\ p = 1 and 



\w\ 



1, and the general case follows from a scaling argument. 



The triangle inequality for \\v\\ p is known as Minkoski's inequality, and 
one can also derive it from Holder's inequality, in analogy with the p = 2 
case. Let us restrict our attention to 1 < p < oo, since the p — 1, oo cases 
can be handled directly. For all v, w in R n or in C n we have that 



(1.25) \\v + w\\i<y: 

3=1 



Vj\ \Vj +w j \ p 1 + \v>j\ h + Wj\ p 1 - 

3=1 



If q is the exponent conjugate to p, then Holder's inequality implies that 

/ n s l/ q 

(1.26) \\v + w\\l<(\\v\\ p +\\w\\ p ) ]T \ Vj + Wj \^-V . 

S=i J 



This can be rewritten as 

(i.27) lh> + HI»< (NIp + H 



\v + w 



\p-l 

\ P 5 



which implies that \\v + w\\ p < \\v\\ p + as desired. 
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If v is an element of R™ or of C n and 1 < p < oo, then 
(1-28) H^Hoo < \\v\\ p . 

More generally, ifl<p<g<oo, then 

(1.29) Nl?< Nip- 
Indeed, 

n 

(1.30) \H q q = Y.\vj\ q <\M q ^\Hl< \H q p . 

3=1 

Of course 

(1.31) IMIp < IMU 

for all v in R n or C n and 1 < p < oo. For 1 < p < q < oo one can check that 



1.32) ||v|| p < n (1/p) " (1/9) \\v 



using Holder's inequality. 

If V is a real or complex vector space and ||i>|| is a norm on V, then 

(1.33) \\v\\ < \\w\\ + \\v — w\\ 
and 

(1.34) ||w|| < \\v\\ + \\v — w\\ 

for all v,w e V, by the triangle inequality. Therefore 



;i.35) 



< m — u; 



for all v,w G l 7 . In particular, \\v\\ is continuous on V as a real-valued 
function with respect to the metric associated to the norm on V. 

If V is R ra or C ra , then it is easy to see that \\v\\ is bounded by a constant 
times the standard Euclidean norm ||i>||2, by expressing v as a linear combi- 
nation of the standard basis vectors. It follows that \\v\\ is continuous as a 
real-valued function with respect to the usual Euclidean topology on R n or 
C™. By standard results from advanced calculus, the minimum of \\v\\ over 
the set of i>'s such that \\v\\2 = 1 is attained, since the latter is compact, and 
of course the minimum is positive because \\v\\ > when v ^ 0. This implies 
that 1 1 v|| is also greater than or equal to a positive constant times ||i>||2- As 
a consequence, the topology determined by the metric ||i> — w\\ is the same 
as the standard Euclidean topology on R n , C n , as appropriate. 
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2 Separation theorems 



Fix a positive integer n, and let E be a nonempty closed convex subset of 
R n . Also let p be a point in R™ which is not in E. There exists a point q E E 
such that the Euclidean distance \\p — q\\2 from p to q is as small as possible. 

Let H be the affine hyperplane through q which is orthogonal to p — q. 
In other words, using the standard inner product on R™, H consists of the 
v G R n such that the inner product of v — q with p — q is equal to 0. 

If x is any element of E, then x lies in the closed half-space in R™ which 
is bounded by H and which does not contain p. This is equivalent to saying 
that the inner product of x — q with p — q is less than or equal to 0, while 
the inner product of p — q with itself is equal to ||p — > 0. One can see 
this through a simple geometric argument, to the effect that if x G E lies in 
the open half-space in R n containing p, then there is a point along the line 
segment joining x to q which is closer to p than q is. 

It follows that in fact E is equal to the intersection of the closed half- 
spaces containing it. Namely, each point in R™ which is not in E is also in 
the complement of one of the closed half-spaces containing E. 

Remark 2.1 The use of the Euclidean norm here may seem a bit strange, 
since the statement that q G E and H is a hyperplane through q such that 
E is contained in a closed half-space in R n bounded by H and p is in the 
complementary open half-space bounded by H does not require the Euclidean 
norm or inner product. One could just as well use a different inner product 
on R n , which could lead to a different choice of q and H. Observe however 
that if q and H the properties just mentioned, then there is an inner product 
on R n such that the distance from q to p in the corresponding norm is as 
small as possible and H is the hyperplane through q which is orthogonal to 
q-p. 

Next suppose that E is a closed convex subset of R™ and that p is a 
point in the boundary of E. Thus p G E and there is a sequence of points 
{pj}j ( L 1 in H n \E which converges to p. In this case there is a hyperplane H 
in R n which passes through p such that E is contained in one of the closed 
half-spaces bounded by H. We can reformulate this by saying that there is 
a vector v G R n such that ||i>||2 = 1 and for each x G E we have that the 
inner product of x — p with v is greater than or equal to 0. From the previous 
argument we know that for each j there is a point qj G E such that \\qj — Pj\\2 
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is as small as possible and for each x G E the inner product of x — qj with 
qj — p is greater than or equal to 0. 

Put Vj = (qj—p)/\\qj—p\\2, so that \\vjW2 = 1 for all j by construction. By 
passing to a subsequence if necessary we may assume that {vj} ( *L 1 converges 
to a vector v G R™ such that \\v\\ 2 = 1. It is easy to check that v has the 
required properties, since {qj}jL 1 converges to p. 

Now let C be a closed convex cone in R n , which means that C is a closed 
subset of R n , G C, for each i> G C and positive real number t we have that 
tv E C, and for each t>, w G C we have that t> + w G C. Suppose that z is 
a point in R n which is not in C, so that t z is not in C for any positive real 
number t. Let us check that there is a hyperplane in R™ which passes through 
such that C is contained in one of the closed half-spaces in R n bounded by 
H and z is contained in the complementary open half-space bounded by H. 
This is equivalent to saying that there is a vector v G R n such that \\v || 2 = 1, 
the inner product of v with any element of C is greater than or equal to 0, 
and the inner product of v with z is strictly less than 0. 

From the earlier arguments there is a q G C such that for any x G C 
the inner product of x — q with q — z is greater than or equal to 0. Put 
v — (q — z)/ 1| q — z || 2 , so that \v\i = 1 automatically and the inner product 
of x — q with v is greater than or equal to for all x G C. Because and 

2 q are elements of C, we have that the inner product of —q, q with v are 
greater than or equal to 0, which is to say that the inner product of q with v 
is actually equal to 0. Thus the inner product of any x G C with v is greater 
than or equal to 0, and the inner product of z with v is negative is equal to 
the inner product of z — q with v, which is —\\z — q\\2 < 0. 

3 Dual spaces 

Let V be a finite-dimensional real or complex vector space, and let V* denote 
the corresponding dual vector space of linear functionals on V. Thus the 
elements of V* are linear mappings from V into the real or complex numbers, 
as appropriate. If V is a real or complex vector space, then V* is too, because 
one can add linear functionals and multiply them by scalars. 

Suppose that the dimension of V is equal to n, and that vi, . . . ,v n is a 
basis for V. Thus every element of V can be expressed in a unique manner as 
a linear combination of the Vj's. If A G V*, then A is uniquely determined by 
the n scalars A(i>i), . . . , X(v n ), and these scalars may be chosen freely. Thus 
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V* also has dimension equal to n. 

Suppose that V is equipped with a norm \\v\\. If A is a linear functional 
on V, then there is a nonnegative real number k such that 

(3.1) \X(v)\ < k\\v\\ 

for all v G V. To see this, one might as well assume that V is equal to R n or 
C n , using a basis for V to get an isomorphism with R n or C n . As we have 
seen, any norm on R" or C" is equivalent to the standard Euclidean norm, 
in the sense that each is bounded by a constant multiple of the other. The 
existence of an k > as above then follows from the corresponding statement 
for the Euclidean norm. 

Let us define the dual norm of a linear functional A on V associated to 
the norm \\v\\ on V by 

(3.2) ||A||* = sup{|A(w)| : v E V, \\v\\ <}. 
Equivalently, 

(3.3) |A(v)| < ||A||*|H| 

for all v & V, and ||A||* is the smallest nonnegative real number with this 
property. One can check that ||A||* does indeed define a norm on V*. 

For instance, suppose that V is equipped with an inner product (v,w). 
For each w G V, 

(3.4) X w {v) = {v,w) 

defines a linear functional on V, and in fact every linear functional on V 
arises in this manner. With respect to the norm on V associated to the inner 
product, the dual norm of X w is less than or equal to the norm of w, by the 
Cauchy-Schwartz inequality. By choosing v = w one can check that the dual 
norm of A^ is equal to the norm of w. 

Now suppose that V is R n or C n , and for each w in R™ or C n , as appro- 
priate, consider the linear functional X w on V given by 

n 

(3.5) X w {v) — ^vjWj, 

3=1 

v = (v\, . . . , v n ), w = (wx, . . . , w n ). Every linear functional on V arises in this 
manner. If V is equipped with the norm ||t>|| p from Section 1 < p < oo, 
then the dual norm of X w is equal to \\w\\ q , where q is the exponent conjugate 
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to p. Indeed, the dual norm of X w is less than or equal to \\w\\ q by Holder's 
inequality. Conversely, one can show that the dual norm of X w is greater 
than or equal to \\w\\ q through specific choices of v. 

If V is any finite-dimensional real or complex vector space equipped with 
a norm || • ||, and if v is any vector in V, then 



just by the definition of the dual norm. It turns out that for each nonzero 
vector v G V there is a linear functional A on V such that ||A||* = 1 and 
X(v) = \\v\\. To see this we may as well assume that \\v\\ = 1, by scaling. 

Assume first that V is a real vector space, which we may as well take to 
be R n . The closed unit ball in R n associated to || • ||, consisting of vectors 
with norm less than or equal to 1, is a compact convex subset of R n , and v 
lies in the boundary of this convex set, since ||t>|| = 1. As in Section |21 there 
is a hyperplane H through v such that the closed unit ball associated to the 
norm is contained in one of the closed half-spaces bounded by H. The linear 
functional A on R n that we want is characterized by 



Now suppose that V is a complex vector space. If A is a linear mapping 
from V to the complex numbers, then the real part of A is a real-linear 
mapping from V into the real numbers, i.e., it is a linear functional on V as 
a real vector space, without the additional structure of scalar multiplication 
by i. Conversely, if one starts with a real-linear mapping from V into the 
real numbers, then that is the real part of a unique complex-linear mapping 
from V into the complex numbers, as one can verify. 

If j3 is any complex number, then the modulus of j3 can be described as the 
supremum of the real part of a (3, where a runs through all complex numbers 
with | a | < 1. As a result, if V is a complex vector space, || • || is a norm on 
V, and A is a complex linear functional on V, then the dual norm of A can be 
described equivalently as the supremum of the real part of a X(z) as a runs 
through all complex numbers with \a\ < 1 and z runs through all vectors in 
V with \\z\\ < 1. Hence the dual norm of A is equal to the supremum of the 
real part of A (z) as z runs through all vectors in V with < 1, because 
one can absorb the scalar factors into z. In other words, the norm of A as a 
complex linear functional on V is equal to the norm of the real part of A as a 
real linear functional on V, using the same norm on V. This permits one to 



(3.6) 




(3.7) 



H = {x e R n : X(x) = 1}. 
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derive the complex case of the statement under consideration from the real 
case. 

4 Quotient spaces, norms 

Let V be a finite-dimensional real or complex vector space, and let W be a 
linear subspace of V. Consider the quotient space V/W, which is basically 
defined by identifying points in V whose difference lies in W. There is a 
canonical quotient mapping q, which is a linear mapping from V onto W. 

Suppose also that V is equipped with a norm \\v ||. Thus we get a metric 
associated to this norm, and with respect to this metric W is a closed subset 
of V. Indeed, in R n or C n , every linear subspace is a closed subset. The 
general case can be derived from this one because V is isomorphic to R n or 
C n for some n, and the norm on V is equivalent to the usual Euclidean norm 
on R n or C n , as appropriate, with respect to this isomorphism. 

Let us define a quotient norm || • \\v/w 011 V/W by saying that the norm 
of a point in V/W is equal to the infimum of the norms of the points in 
V which are identified to that point in the quotient. Equivalently, for each 
x £ V, the norm of q(x) in V/W is equal to the infimum of the norms of 
x + w in V over w G W. In particular, ||?(;E)||y/w < \\ x \\ f° r an x EV . It 
is not difficult to check that this does indeed define a norm on the quotient 
space V/W. 

Now let Z be a linear subspace of V, and suppose that A is a linear 
functional on Z. We would like to extend A to a linear functional on V 
whose dual norm on V is the same as that of A on Z, using the restriction 
of the given norm on V to Z as a norm on Z. We may as well assume that 
A is not the zero linear functional, which is to say that X(z) ^ for at least 
some z £ Z. Let W denote the kernel of A, which is the linear subspace of 
Z consisting of all vectors y G Z such that X(y) = 0. 

Let us work in the quotient space V/W. The quotient Z/W is a one- 
dimensional subspace of V/W. Because W is the kernel of A, there is a 
canonical linear functional on Z/W induced by A. One can check that the 
norm of this linear functional on Z/W, associated to the quotient norm on 
Z/W obtained from our original norm || ■ || on V, is equal to the norm of A 
as a linear functional on Z. 

Because Z/W has dimension equal to 1, there is a linear functional fi 
on V/W with dual norm equal to 1 with respect to the quotient norm on 
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V/W such that for each element of Z/W, the absolute value or modulus 
of n applied to that element is equal to the quotient norm of that element. 
This follows from the result discussed in Section El applied to V/W with 
the dual norm. We can multiply \x by a scalar to get a linear functional 
on V/W whose norm is equal to the norm of A on Z and which agrees on 
Z/W with the linear functional induced there by A. The composition of this 
linear functional on V/W with the canonical quotient mapping from V onto 
W gives a linear functional on V which extends A from Z to V and has the 
same norm as A has on Z. 

5 Dual cones 

Let V be a finite-dimensional real vector space, and let C be a closed con- 
vex cone in V. To be more precise, one can use an isomorphism between V 
and R n to define the topology on V, i.e., so that the vector space isomor- 
phism is a homeomorphism. This topology does not depend on the choice 
of isomorphism with R n , because every invertible linear mapping on R n de- 
fines a homeomorphism from R n onto itself. Thus C is a closed subset of V 
which contains and has the property that sv + tw G V whenever s,t are 
nonnegative real numbers and v,w G C. 

Let us define C* to be the set of linear functionals A on V such that 
X(v) > for all v G C. One can check that C* defines a closed convex cone in 
V*. This is called the dual cone associated to C. It follows from the result in 
Section El for closed convex cones that C is actually equal to the set of v G V 
such that AO) > for all A G C* . 

As a basic example, let V be R™ for some positive integer n, and let C be 
the closed convex cone consisting of vectors v = (v i, . . . , v n ) such that Vj > 
for all j. For each w G R™, we get a linear functional X w on R n by putting 
X w (v) = Sj=i v j w ji an d every linear functional on R n arises in this manner. 
For this cone C, the dual cone C* consists of the linear functionals X w such 
that w G C, as one can readily verify. 

Now let W be a finite-dimensional real or complex vector space equipped 
with an inner product (w,z), and let V be the real vector space of linear 
mappings A from W to itself which are self-adjoint, which is to say that 
(A(w),z) is equal to (w,A(z)) for all w,z G W. A self-adjoint linear trans- 
formation A on W is said to be nonnegative if (A(w),w) is nonnegative real 
number for all w G W, and the nonnegative self-adjoint linear transforma- 
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tions on V form a closed convex cone in the real vector space of self-adjoint 
linear transformations on V. If T is a self-adjoint linear transformation on 
V, then we get a linear functional At on the vector space of self-adjoint lin- 
ear transformations on W by setting Xt(A) equal to the trace of A o T for 
any self-adjoint linear transformation A on W, and every linear functional 
on the vector space of self-adjoint linear transformations on W arises in this 
manner. If T is a self-adjoint linear transformation on W, then At (A) > 
for all nonnegative self-adjoint linear transformations A on W if and only if 
T is nonnegative. This can be verified using the fact that a self-adjoint linear 
transformation on W can be diagonalized in an orthonormal basis. 

6 Operator norms 

Let V, W be finite-dimensional vector spaces, both real or both complex, 
and let C(V, W) be the vector space of linear mappings from V to W. More 
precisely, this is a real vector space if V, W are real vector spaces and it is 
a complex vector space if V, W are complex vector spaces. Notice that the 
dual V* of V is the same as C(V, R) when V is a real vector space and it is 
the same as C(V, C) when V is a complex vector space. 

Suppose that V, W are equipped with norms \\v\\v, \\w\\w- If T is a linear 
mapping from V to W, then there is a nonnegative real number k such that 

(6.1) \\T{v)\\ w <k\\v\\ v 

for all v G V. This can be derived from the case of mappings between 
Euclidean spaces in the usual manner, and it basically amounts to saying 
that T is continuous as a mapping from V to W with respect to the metrics 
associated to the norms on V, W. 

We define the operator norm of T as a linear mapping from V to W by 

(6.2) ||r||op,vw = sup{||2\v)||w : v E V, \\v\\ v < 1}. 

Equivalently, ||T|| op yyi/ is the smallest nonnegative real number that one can 
use as k in the preceding paragraph. It is easy to see that ||T|| oPi yw does 
indeed define a norm on C(V, W). In the case where W is equal to R or C, 
so that £(V, W) is equal to V*, the operator norm reduces to the dual norm 
of a linear functional as defined in Section El 

As another equivalent definition, the operator norm of T is equal to the 
supremum of \{i(T(v))\ over v £ V, \i G W* where the ^/-norm of v and the 
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W^-norm of /x are each less than or equal to 1. That \fi(T(v)) \ is less than or 
equal to the operator norm of T for these v 's and /i's follows easily from the 
definition. The operator norm is equal to the supremum of these quantities 
because norms in W are detected by linear functionals as in Section 

For each linear mapping T from V to W there is an associated dual linear 
mapping T* from W* to V*, defined by saying that if /i is a linear functional 
on W, then T*(/x) is the linear functional on V given by the composition of 
\i with T. One can check that the operator norm o T*, with respect to the 
dual norms on V*, W*, is equal to the operator norm of T with respect to 
the original norms on V, W. 

As a special case, suppose that V is equal to R m or C m for some positive 
integer m, equipped with the norm \\v\\i = \vi\ + • — h \v m \. If ei, . . . , e m are 
the standard basis vectors for V, so that the Zth component of ej is equal to 
1 when j = I and to when j ^ I, then one can show that the operator norm 
of a linear mapping T from V into a normed vector space W is equal to the 
maximum of ||T(ei)|| w , • . • , ||T(e m )|| w . 

Suppose instead that W is equal to R n or C n for some positive integer 
n, equipped with the norm ||w||oo = max(|u>i|, . . . , \w n \). A linear mapping 
T from a normed vector space V into W is basically the same as a collection 
Ai, . . . , A n of n linear functionals on V, corresponding to the n components 
of T(v) in W. The operator norm of T is then equal to the maximum of the 
dual norms of Ai, . . . , A n with respect to the given norm on V. 

7 Trace norms 

Let V, W be finite-dimensional vector spaces, both real or both complex, 
and let || • ||y, || • \\w be norms on V, W, respectively Also let T be a linear 
mapping from V to W. We can express T as 

(7.i) r(«) = E^)% 

for some linear functionals Ai, . . . , Aj on V and some vectors W\, . . . , wi in W. 

If A G V* and w G W , then \(v) w defines a linear mapping from V to W 
with rank 1, unless A and w are both in which event the linear mapping is 
0. The operator norm of this linear mapping is equal to the product of the 
dual norm of A and the norm of w in W. If T is given as a sum as above, then 
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for each j one can take the product of the dual norm of Xj and the norm of 
Wj in W, and the sum of these products is a nonnegative real number which 
is greater than or equal to the operator norm of T. The trace norm of T 
is denoted ||T|| tr) yjy and defined to be the infimum of this sum of products 
over all such representations of T. It is easy to see that the trace norm does 
indeed define a norm. In particular we have that 

(7-2) 1 1 op, VW < 1 1^11 tr,VW 

by the earlier remarks, which shows that the trace norm of T is equal to if 
and only if T is equal to 0. At any rate, the homogeneity and subadditivity 
of the trace norm can be derived directly from the definition. 

If T is a linear mapping from V to W and A is a linear mapping from W 
to V, then the composition A o T is a linear mapping from V to itself, and 
we can take its trace tr A o T in the usual manner. If T(v) = X(v) w for some 
A G V* and w G W, then (A o T)(v) = X(v) A(w), and the trace of A o T is 
equal to X(A(w)). Using this one can check that 



for all linear mappings A : W — > V and T : V — > W. One can think 
of T i— > tr A o T as a linear functional on C(V, W), and the dual norm of 
this linear functional with respect to the trace norm on C(V, W) is equal to 



8 Vector-valued functions 

Let E be a finite nonempty set. If V is a real or complex vector space, let 
us write J-(E, V) for the vector space of functions on E with values in V. 
Thus J-{E, R), J-{E, C) denote the vector spaces of real or complex- valued 
functions on 

If 1 < p < oo, let us write ||/|| p for the usual p-norm of a real or complex- 
valued function / on E, so that 



(7.3) 



trAoT| < ||A||op >W v llTllfr.yw 




op,WV- 



(8.1) 




when 1 < p < oo and 



(8.2) 



11/11 



oo 



max{|/(x)| : x G £"}. 
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Let V be a vector space equipped with a norm \\v ||, and let us extend the 
p-norms to V-values functions on E by putting 



(8.3) 



ll/IU=(£ll/(*)ll p ) 



when 1 < p < oo and 



(8.4) 



||/|U, v = nuK{||/(x)|| :x£E}, 



for any V-valued function / on E. It is easy to check that these do define 
norms on J-{E, V), using the properties of the norm ||t>|| on V and the p- 
norms for scalar-valued functions. 

Let T be a linear transformation on the vector space of real or complex- 
valued functions on E. If V is a real or complex vector space, as appropriate, 
then T induces a natural linear transformation on the vector space of V- 
Valued functions on E. For instance, for each x G E and scalar-valued 
function / on E, T(/)(x) is a linear combination of f(y), y € E, and one can 
use the same coefficients to define T(f) when / is a vector-valued function. 

In general the relationship between the operator norm of T acting on 
scalar-valued functions and the operator norm of T acting on vector-valued 
functions can be complicated. If V happens to be R™ or C™ equipped with a 
p-norm, and if we use the p-norm for scalar valued functions on E, then the 
operator norm of T on scalar-valued functions with respect to the p-norm 
will be the same as the operator norm of T acting on V-valued functions 
with respect to the norm defined above. 

Fix p, 1 < p < oo, and a positive integer n. Let S™" 1 denote the standard 
unit sphere in R™ equipped with the Euclidean norm, which is the compact 
set of vectors with Euclidean norm equal to 1. Let V be the vector space of 
real- valued continuous functions on S n_1 . 

We can define a p-norm on V by taking the integral of the pth power of 
the absolute value of a continuous real- valued function on S n_1 , and then 
taking the (l/p)th power of the result. Here we use the standard element of 
integration on S™ -1 which is invariant under rotations, and which one may 
wish to normalize so that the total measure of the sphere is equal to 1. 

If T is a linear transformation acting on real- valued functions on E, then 
we get a linear transformation acting on V-valued functions as before. The 
operator norm of T acting on real- valued functions and using the p-norm on 
them is equal to the operator norm of the associated linear transformation 
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acting on V- valued functions using the norm based on the p-norm for 

functions on S n_1 described in the preceding paragraph. 

Let L denote the linear subspace of V consisting of functions on S n_1 
which are restrictions of linear functions from R™, so that each function in L 
is given by the inner product of the point in the sphere with some fixed vector 
in R n . In this way we can identify L with R™, and the restriction of the p- 
norm on V to L corresponds to a constant multiple of the usual Euclidean 
norm on R n . Using this it follows that if T is a linear operator acting on 
real-valued functions on E, then the operator norm of T with respect to the 
p-norm on real-valued functions on E is the same as the operator norm of 
the corresponding linear transformation acting on R n -valued functions, using 
the norm on Revalued functions obtained from the p-norm on real-valued 
functions and the Euclidean norm on R™. 

References 

[BenL] Y. Benyamini and J. Lindenstrauss, Geometric Nonlinear Func- 
tional Analysis, Colloquium Publications 48, American Mathemat- 
ical Society, 2000. 

[Boc] S. Bochner, Lectures on Fourier Integrals, translated by M. Tenen- 
baum and H. Pollard, Annals of Mathematics Studies 42, Princeton 
University Press, 1959. 

[BocC] S. Bochner and K. Chandrasekharan, Fourier Transforms, Annals 
of Mathematics Studies 19, Princeton University Press, 1949. 

[Duo] J. Duoandikoetxea, Fourier Analysis, translated and revised by 
D. Cruz-Uribe, SFO, American Mathematical Society, 2001. 

[GarR] J. Garcia-Cuerva and J. Rubio de Francia, Weighted Norm Inequal- 
ities and Related Topics, North-Holland, 1985. 

[Gol] R. Goldberg, Methods of Real Analysis, 2nd edition, Wiley, 1976. 

[HewS] E. Hewitt and K. Stromberg, Real and Abstract Analysis, Springer- 
Verlag, 1975. 



17 



[JohL] W. Johnson and J. Lindenstrauss, editors, Handbook of the Geom- 
etry of Banach Spaces, Volumes 1 and 2, North- Holland, 2001 and 
2003. 

[Krai] S. Krantz, Real Analysis and Foundations, CRC Press, 1991. 

[Kra2] S. Krantz, A Panorama of Harmonic Analysis, Mathematical As- 
sociation of America, 1999. 

[LinT] J. Lindenstrauss and L. Tzafriri, Classical Banach Spaces, I, Se- 
quence Spaces and II, Function Spaces, Springer- Verlag, 1977 and 
1979. 

[MilS] V. Milman and G. Schechtman, Asymptotic theory of finite- 
dimensional normed vector spaces, with an appendix by M. Gro- 
mov, Lecture Notes in Mathematics 1200, Springer- Verlag, 1986. 

[Rudl] W. Rudin, Principles of Mathematical Analysis, 3rd edition, 
McGraw-Hill, 1976. 

[Rud2] W. Rudin, Real and Complex Analysis, 3rd edition, McGraw-Hill, 
1987. 

[Rud3] W. Rudin, Functional Analysis, 2nd edition, McGraw-Hill, 1991. 

[Ste] E. Stein, Singular Integrals and Differentiability Properties of Func- 
tions, Princeton University Press, 1970. 

[SteS] E. Stein and R. Shakarchi, Fourier Analysis: An Introduction, 
Princeton University Press, 2003. 

[SteW] E. Stein and G. Weiss, Introduction to Fourier Analysis on Eu- 
clidean Spaces, Princeton University Press, 1971. 

[Woj] P. Wojtaszczyk, Banach Spaces for Analysts, Cambridge University 
Press, 1991. 

[Zyg] A. Zygmund, Trigonometric Series, Volumes I and II, 3rd edition, 
Cambridge University Press, 2002. 



18 



